Flux through a Markov chain
نویسندگان
چکیده
In this paper we study the flux through a finite Markov chain of a quantity, that we will call mass, which moves through the states of the chain according to the Markov transition probabilities. Mass is supplied by an external source and accumulates in the absorbing states of the chain. We believe that studying how this conserved quantity evolves through the transient (non-absorbing) states of the chain could be useful for the modelization of open systems whose dynamics has a Markov property.
منابع مشابه
Development of Markov Chain Grey Regression Model to Forecast the Annual Natural Gas Consumption
Accurate forecasting of annual gas consumption of the country plays an important role in energy supply strategies and policy making in this area. Markov chain grey regression model is considered to be a superior model for analyzing and forecasting annual gas consumption. This model Markov is a combination of the Markov chain and grey regression models. According to this model, the residual er...
متن کاملAbsorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping
In this paper, absorbing Markov chain models are developed to determine the optimum process mean levels for both a single-stage and a serial two-stage production system in which items are inspected for conformity with their specification limits. When the value of the quality characteristic of an item falls below a lower limit, the item is scrapped. If it falls above an upper limit, the item is ...
متن کاملA Bayesian inference approach to the inverse heat conduction problem
A Bayesian inference approach is presented for the solution of the inverse heat conduction problem. The posterior probability density function (PPDF) of the boundary heat flux is computed given temperature measurements within a conducting solid. Uncertainty in temperature measurements is modeled as stationary zero-mean white noise. The inverse solution is obtained by computing the expectation o...
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملDetection and prediction of land use/ land cover changes using Markov chain model and Cellular Automata (CA-Markov), (Case study: Darab plain)
unprincipled changes in land use are major challenges for many countries and different regions of the world, which in turn have devastating effects on natural resources, Therefore, the study of land-use changes has a fundamental and important role for environmental studies. The purpose of this study is to detect and predicting of land use/ land cover (LULC) changes in Darab plain through the Ma...
متن کامل